Multimodal Annotation of Conversational Data
نویسندگان
چکیده
We propose in this paper a broad-coverage approach for multimodal annotation of conversational data. Large annotation projects addressing the question of multimodal annotation bring together many different kinds of information from different domains, with different levels of granularity. We present in this paper the first results of the OTIM project aiming at developing conventions and tools for multimodal annotation.
منابع مشابه
Capturing Form of Non-verbal Conversational Behavior for Recreation on Synthetic Conversational Agent EVA
Several features of human-human conversation have to be accounted for in order to recreate conversational behavior on a synthetic model, as natural as possible.. Spontaneous conversations are a combination of multiple modalities (e.g. gestures, postures, gazes, expressions) in order to effectively convey information between participants. This paper presents a novel process for capturing the for...
متن کاملKnowledge-based Multimodal Data Representation and Querying
This paper focuses on the representation and querying of knowledge-based multimodal data. Our work stands in the multidisciplinary project OTIM (Tools for Multimodal Annotation) dedicated to the development of tools for multimodal annotation of french conversational data. OTIM aims at encoding and manipulating annotations from all the linguistic domains in an unique framework. Defining a data m...
متن کاملTowards a Multimodal Dialogue Coding Scheme
In this paper a coding scheme for annotating speech acts in the context of multimodal design tasks is presented. The scheme is an extension of the dialogue act markup in several layers scheme (DAMSL). The proposed annotation scheme augments DAMSL in two different directions: Firstly, utterance constituting the basic level of structure that is accounted by DAMSL are grouped into contributions th...
متن کاملAutomatic analysis of multiparty meetings
This paper is about the recognition and interpretation of multiparty meetings captured as audio, video and other signals. This is a challenging task since the meetings consist of spontaneous and conversational interactions between a number of participants: it is a multimodal, multiparty, multistream problem. We discuss the capture and annotation of the AMI meeting corpus, the development of a m...
متن کاملThe UTEP-ICT Cross-Cultural Multiparty Multimodal Dialog Corpus
To help answer questions about conversational control behaviors across cultures, a collaborative team from the University of Texas at El Paso and the Institute for Creative Technologies collected and partially coded approximately ten hours of audiovisual multiparty interactions in three different cultures and languages. Groups of four native speakers of Arabic, American English and Mexican Span...
متن کامل